DataBlitz: A High Performance Main-Memory Storage Manager

DataBlitz’ is a main-memory storage management toolkit that supports the development of highperformance and fault-resilient applications requiring concurrent access to shared data. By combining transactions, data organization, and fault-resilience with direct access to data, DataBlitz bridges the gap between the speed of data structures in shared memory and the safety and convenience of a traditional database system. The architecture of Datablitz differs significantly from that of commercially available database management systems as it is optimized for high performance in the case when sufficient main-memory is available to hold the entire database. Our benchmark results indicate that DataBlitz can deliver as high as 50 times the performance of commercial disk-based systems. Most commercial database systems have a clientserver architecture, assume data is primarily diskresident, and have a buffer manager to cache the diskresident data. Consequently, the performance of applications on these systems suffer since each access incurs network latency and buffer manager overhead. Also, most commercial systems expose to applications only high-level interfaces (e.g., SQL) which provide additional functionality at the cost of increased processing overhead. In contrast, Datablitz eliminates inter-process communication and the buffer manager by mapping the entire database directly into the address space of the application’s process. By locking the entire database